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Abstract 

We prove that the general mean-field type networks at low load 
behave in accordance with the Poisson Hypothesis. That means that 
the network equilibrates in time independent of its size. This is a 
"high-temperature" counterpart of our earlier result, where we have 
shown that at high load the relaxation time can diverge with the 
size of the network ("low-temperature"). In other words, the phase 
transitions in the networks can happen at high load, but cannot take 
place at low load. 
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1 Introduction 

The Poisson Hypothesis is a device to predict the behavior of large queuing 
networks. It was formulated first by L. Kleinrock, and concerns the following 
situation. 
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Suppose we have a large network of servers, through which many cus- 
tomers are traveling, being served at different nodes of the network. If the 
node is busy, the customers wait in the queue. Customers are entering into 
the network from the outside via some nodes, and these external flows of cus- 
tomers are Poissonian, with constant rates. The service time at each node is 
random, depending on the node, and the customer. 

We are interested in the stationary distribution ix^- at a given node Af: 
what is the distribution of the queue at Af, what is the average waiting time, 
etc. 

Except for a very few special cases, when the service times are exponen- 
tial, the distributions 7T/v in general can not be computed. The recipe of the 
Poisson Hypothesis for approximate computation of 7T/v and the prediction 
for the (long-time, large-size) behavior of the network is the following: 

• Consider the total flow T of customers to a given node Af. Then T is 
approximately equal to a Poisson flow, V , with a time dependent rate 
function (T) . 

• The exit flow from Af - not Poissonian in general! - has a rate function 
7/V (T) , which is smoother than Xj^ (T) (due to averaging, taking place 
at the node Af) . 

• As a result, the flows Xj^(T) at various nodes Af should converge to 
constant limits Aj^ ~ f; Jq X (t) dt, as T — > oo, the flows to different 
nodes being almost independent. 

• The above convergence is uniform in the size of the network. 

• Compute the stationary distribution -ftj^ at Af, corresponding to the 
inflow ViX^r). (These computations are the subject of classical queuing 
theory and usually provide explicit formulas.) The claim is that tt^ ~ 
KM- 

The Poisson Hypothesis is supposed to give a good estimate if the internal 
flow to every node Af is a sum of flows from many other nodes, and each of 
these flows constitute only a small fraction of the total flow to Af. 

Clearly, the Poisson Hypothesis can not be literally true. It can hopefully 
hold only after some kind of "thermodynamic" limit is taken. Its meaning 
is that in the long run the different nodes become virtually independent, i.e. 
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propagation of chaos takes place. The reason for that should be that any 
synchronization of the nodes, if initially present, dissolves with time, due to 
the randomness of the service times. 

For some time it was believed that the Poisson Hypothesis behavior is a 
general characteristic of all large highly connected networks. It was proven in 
some special cases in |Stlj and [RShlj . However, the counterexamples were 
also found recently (see [RSh2j . where some special service times were con- 
sidered, and especially [R ShVl] , where the network with exponential service 
times is constructed, for which the PH breaks down at high load). We think 
that the situation here resembles the one of statistical mechanics, where all 
the models behave alike at high temperatures, while at low temperatures 
some of them exhibit phase transition behavior. In the network context 
the role of the temperature is played by the average load per server, p, and 
the example described in [RShVlJ is the example of such (first-order) phase 
transition at high load, where the corresponding infinite system has multi- 
ple equilibrium states. In the present paper we pursue this analogy further, 
by showing that under very general conditions the Poisson Hypothesis holds 
for general mean-field type closed networks described below in the low load 
regime. In the forthcoming paper [RShV2] we will prove similar results for 
open networks. 

1.1 The elementary network 

Let G = (V, E) be a finite graph. We want to think about the graph G 
as a network of servers, serving clients. So we suppose that G is endowed 
with some extra structures. First, at every server v G V there might be 
clients of different nature, so we associate to every v a (finite) set of types 
- or colors - {c G C (v)} . So we introduce the disjoint union V = U^gyC (v) 
of all possible types of clients. We connect a pair (vi, c\) to a pair (u 2 , c 2 ) , 
where Cj G C (vi) , by a directed bond, e G E, if (i>i,i> 2 ) is an edge in E, and 
moreover if it can happen that a client of type c\ is served by the server v\ 
and as a result is sent to the server v 2 as a type c 2 client. 

Thus far we just described another (bigger, and directed) graph, G = 
iy,E) ■ Next, we have to specify the service times. We suppose them to 
have exponential distribution, with the rates j(v,c) > 0. 

The last piece of information we want to have on G is the transition prob- 
ability matrix, P — \\P [(yx, ci) , (v 2 , c 2 )]|| . The number P \{v\, Cx) , (v 2 , c 2 )] is 
the probability that the client of type Cx at the node Vx will go to the node 
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v 2 as a type c 2 client. 

The condition we want to impose on our elementary network (G, 7) is 
that of connectedness: 

Condition 1 Let us consider a continuous time Markov process on G, cor- 
responding to the Case of a Single Client. That means that we have just one 
client in our network. Initially it is sitting at some server v, having some 
color c e C(v) . As time goes, the client is changing his location and color 
randomly, with the rates given by the rate function 7 (•,•), and transition 
probabilities P. We want this (continuous time finite state) Markov process 
to be ergodic. (This is equivalent to the ergodicity of the Markov chain defined 
by P.) 

In the networks that we are going to consider, there will be many clients, 
so we need to describe what happens if several clients come for the service 
to the same server. Here we can treat a fairly general situation. Suppose 
that at the server v at time t we have a queue x v = {c±, c 2 , c k } of clients, 
Q G C (v) . That means that these clients came to v before t, and are still 
there at the moment t, waiting to be served. They are listed in the order of 
their arrival. The number k = k (x v ) is called the queue length (at v at the 
moment t). The protocol R (v) is a rule i v (*) for the server v, which assigns 
to every non-empty queue x v the index 1 < i v (x v ) < k, which is the index 
of the client in x v who is served at the moment t. Once this client finishes its 
service and leaves the server, the queue x v turns into 

x v [i v (x v ) , Cj„( Xv )} = {ci, c 2 , Ci v ( Xv )-i, Cj„( Xv ) + i, c fc } , (1) 

so k [x v Q {i v (x v ) , Q„(a;„)}) = k (x v ) — 1. 

For example, the server can just serve the clients in the order they arrive, 
l. This protocol is called FIFO - First-In-First-Out. We will 
treat fairly general protocols, with two restrictions. 

The first is that the server can not be idle if there are clients waiting for 
the service. This is called conservative discipline. 

The second is the following monotonicity property. Let c^ 1 , <4 2 , c^ , ... 
be the schedule of arrival of customers to the node v, with U being the moment 
of arrival of the z-th customer. Suppose we know the service time needed 
for every client. Then the protocol R(v) allows us to define the function 
N (t) , which is the length of the queue at the moment t > 0. Consider 
now another arrival schedule, which differs by exactly one extra client c: 
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Cj 1 , Cg 2 , c*% c 4 , cl+l, cjjf, where tj < t < ij+i- Then the queue length 
function would change to a different one, iV c (t) . We need that N c (t) > N (t) 
for all £ > 0. This property holds for most of the natural disciplines. 

(Note that it is allowed that the service of the client c is interrupted once a 
client with higher priority arrives. The service of c is then resumed according 
to the priority rule R(v).) 

1.2 Mean- field type graphs 

Now we associate to the graph G = (V, E) the sequence Gi (G) = G C 
Q2 (G) C ... C Qm (G) C ... of graphs, which is constructed as follows. For 
every M consider a disjoint union of M copies G 1 = (V l ,E l ) of the graph 
G, i — 1, M. Then the graph Qm = (Vm,£m) has for its vertices the set 
Vm = U^y* of all the vertices of these M copies of G. We declare a pair 
(v\,v J 2 ) C Vm to be a bond in £ M , v\ G V\v{ e V j , i,j = 1,...,M iff two 
vertices Vi,v 2 G V are connected by an edge e G E. Thus, every bond of G 
produces exactly M 2 bonds of Em- There are no other bonds in Em- 

For example, if G consists of just one vertex v, connected to itself by a 
loop, then Qm (G) will be a complete graph with M vertices (plus to every 
vertex there is a loop attached). 

We now define the mean field graphs Qm (G) in precisely the same way as 
above. Of course, these graphs have natural orientations, inherited from G. 
We keep the rate functions the same, and we define the transition probability 
matrix Pm by 

Pm [(v\, ci) , (v J 2 , c 2 )] = [(ui, ci) , (v 2 , c 2 )] . 

In what follows we will fix the elementary network (G, 7) , and we will be 
interested in the corresponding mean-field networks Qm (G) , populated by 
N = [pM\ clients. We will call the parameter p the load. We thus have for 
every M the ergodic Markov process on the network Q M (G) with iV clients; 
let us denote this process by V P M , while n M will denote its invariant measure. 
We will be interested in the asymptotic properties of the measures n M as 
M — > 00, as well as in the character of the convergence v M (t) — > tt m of the 
state v p M (t) of the process V P M at time t to its limit n p M . 

Informally speaking, the Poisson Hypothesis for the mean-field networks 
Qm {G) is the following statement about the behavior of the measures v p M (t) 
for large M : if the initial state v p M (0) is chosen reasonably - which means 
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that the initial queues at every node do not exceed some constant K - then 
after some time T (K) , independent of M, 

• the M \ V\ servers of our network become almost independent, i.e. the 
measure v p M (t) is close to a product measure over the set Vm\ 

• at every node v E Vm the process v p M (t) looks as if the inflows of 
all possible types of customers to v are independent Poisson flows V c , 
c E C (v) , with constant rates A c (depending only on p, the graph G 
and the function 7, but not on M or t), which customers are then 
queuing at v and are served according to the service rule R(v) at v, 
and leaving the node after being served. Let us denote the stationary 
state of such a node by ^f Ac > c6C w}. 

In such a case we clearly have the relations 

A <=' = E E KP[(v,c),(v',c')}, (2) 

v&V c£C(v) 

where d EC (V) . They define the set A = {A c , c E F} of the rates of the Pois- 
son inflows up to a common factor, a. Note that the expected number of cus- 
tomers, N = N (A), present in the network G in the state n^gy X^ Xa ' c 1 
considered as a function of a, i.e. N (aX) , is continuous strictly increasing 
in a once A ^ 0. (Here we need the monotonicity property of the service dis- 
cipline R(v)). Therefore the rates A p are uniquely defined by the relations 
(T2]) , supplemented by the equation N (A) = p. The stationary distribution 
of the queues, corresponding to the above Poisson inflows A p will be denoted 
by x p '■ 

xP= Y[ x {^^}. (3) 

To save on notation, we will consider below the case when the service disci- 
pline is FIFO with priorities. To describe it we need to endow every set of 
colors C (v) with priority relation )>=, which is a linear order, and we say that 
the client of type c\ has higher priority than C2 iff C2 ^= c\. At every moment 
when there are several clients waiting at a server for the service, the client 
with the highest priority is served. If there are several such clients, they are 
served in the order they came to the server. The priorities are respected to 
such an extent that even when a high priority client arrives at the time when 
a low priority client is under the service, then the service of the latter is 



6 



interrupted, and is resumed only after the former one leaves the node. The 
(notational) advantage of such discipline is that the queue can be described 
by just a vector in Q = l) c( - v ^. But otherwise our proof can be carried out 
literally 

Due to the symmetry of our network we can consider all the measures 
v m (*) an d 71 m t° be the measures on the same space M. (fl) , interpreting 
them as the frequency of a given state of a given server in the network Qm (Gj . 
Thus, v p M (t) and elements of M. (A4 (Q)) . However, the limiting 

measure v*^ (t) , unlike all the other measures above, is again the element of 
M. (Q) . The process (t) is a Non-Linear Markov Process (NLMP). See 
|RShlj for more details. 

Using these notations, the above claims mean that the convergence v p M it) - 
n p M is uniform in M, and that ir M — > x p as M —>■ oo. The measure x p is called 
"the Poisson Hypothesis behavior". 



2 The main result 

Suppose we are given the elementary network ((5, 7) , which is connected in 
the sense of Condition [TJ We suppose that every server v e V is supplied 
with the conservative service rule R (v) (which allows the server to decide the 
order in which the queuing clients are served). Consider now the sequence 
V P M of Markov process on the networks Qm \y) , M = 1, 2, populated by 
N = \_pM\ clients. Let ir M stands for its invariant measure. 

Theorem 2 There exists the value p = p (G, 7, P) , such that for any p < 
p [G, 7-P) the weak limit liniM^oo ttm exists and is equal to the measure x p ■ 

Our next result deals with the convergence to the stationary states n p M . 
For that, we have to specify the class of the initial states of our Markov 
processes. 

Theorem 3 Suppose we start the Markov process V P M in the state v p M (0) , 
which has the property that at every node v e Vm the queue length k v = 
k (v, t — 0) satisfies 

J exp{xk v } dv p M {0) < K, (4) 
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where x > 0, K are some constants, defined below. Suppose that p < p (G, 7) . 
Then for every local function f we have 



f dv p M (t)- f dn p M 



< ||/||exp{-<rt}, 



where the constant t = r (x, K) does not depend on M . 



3 Proof 

The plan of the proof is the following. First, we establish the exponential 
convergence of the limiting process, (t) , which is NLMP, to its limiting 
state. We will see that the limiting state - x p - is unique, and coincides with 
the Poisson point. Since by the Khasminsky theorem - see Theorem 1.2.14 
in [L] any accumulation point of the sequence tv p m is a stationary measure 
of (t) , while the family ir p M , M = 1,2, ... is compact, that will prove all 
our claims. 

In this paper we present a part of the proof of our theorems for a con- 
crete network studied in |RShVl] . The generalization to other networks is 
st raight forward . 

The graph G in [RShVl] has three vertices, O, A and B. The clients at 
O have no priorities, i.e. JC (Q) | = 1, while the clients at A or B are of two 
types, i.e. \C (A)\ = \C (B) \ = 2. In notations of jRShVlj . C (A) = {A, BA} , 
C (-B) = {B, AB} , and SA-clients have priority over A-clients (at A), while 
AB-clients - over 5-clients (at B). The rates 7 (•, •) are the following: 

7 (O) = 7o = 3, (5) 
7 (A, BA) = 7-BA = 7 {B, AB) = lAB = 2, 
j(A,A) ee lA = 1 (B,B) = lB = 10. 

The matrix P is given by 

O A BA B 

O o \ o \ 

p _ A o o o o 

~ BA 1 o o 

B o o 1 o 

AB 1 o o 

It is clearly ergodic. 



AB 

1 
o 
o 




(6) 
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3.1 Compactness 

We first prove the following compactness statement. 

Lemma 4 Suppose all the initial states v p M (0) of our processes satisfy the 
condition O) , M — 1, 2, ... . Suppose that the load p is small enough. Then 
there exist two values x' and K', such that for all nodes v, all t and M 

J exp {x'k v } dv% (t) < K'. (7) 

Proof. Note that the rate of the flow of the clients of type C\ from the server 
Vi to the server i> 2 , where they turn into the clients of type c 2 , is bounded from 
above by pj (v, c) P [(vi, c\) , (v 2 , c 2 )] . That implies ([7j) for p small enough. 
■ 

Suppose we know the convergence of the generators of the Markov pro- 
cesses V P M to that of the limiting Non-Linear Markov Process V^. That 
implies the convergence of the processes V P M to on any finite time in- 
terval. Suppose also that we can show that the NLMP is ergodic - i.e. 
for every its initial state (0) satisfying (j3J) we have the convergence to 
the (unique) limiting state, (t) — > tt^, which is uniform in the choice of 

(0) . Then, first of all, we have the convergence n 1 ^ — > (oo) as M — > oo. 
Indeed, the family tt^ is compact, due to (JTj) . Since by the Khasminsky the- 
orem - see Theorem 1.2.14 in [L] - any accumulation point of the sequence 
it p M is a stationary measure of V^, while the latter is unique, the convergence 
follows. 

Let us check that the convergence v p M it) — > ix p M is uniform in M. Let e > 
0, and let T = T (e) be the time for which the estimate Pkrov (T) , 7r£j < 
e holds for any initial condition (0) satisfying (J3]) . We will show that for 
all M large enough and for alH > T (e) we have 

Pkrov «/ (*) > Ki) < 3e - ( 8 ) 

Indeed, the state v p M it — T) satisfies (JTj) , and therefore the evolution V^, ap- 
plied to it for time T, results in a state D P M (t) , satisfying pkrov (^m (^) > ^oo) < 
e. But for M large enough pkrov {v p M (t) , v p M (t)) < e, Pkrov (^m, <o) < e, 
so (jHJ) follows. 

So to prove our theorems it remains to show that for any initial state 
u oo (0) °f the NLMP satisfying (j3J) we have the convergence z/£, (t) to x p ■ 
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3.2 The derived process 

We want to study our particle system with many nodes M, or even with 
infinite number of them, in the limit as the number of particles, N, or the 
ratio p = H - goes to zero. Understood literally, the limiting object is trivial. 
We want a non-trivial version of it. The object we construct is very similar 
to the derivative of the function at the point where it vanishes, so we look 
not on the function, but on the properties of its increments. 

We will construct this derived process for the case of M = oo, i.e. for 
the NLMP. It can be defined in the following way. Let first M is finite, 
and N has some value. Let Pm,p be a state of our Markov process. For 
every configuration a of our process we can define a measure v a on Z = 

U veV (z l + (v)l \ o) - the disjoint union of lattices without the origins - which 

is the distribution of "the queue of the average customer" . Namely, for every 
client c, forming a, we consider a point x c in Z, by first taking the server v (c) , 
corresponding to c, and then marking the point x c G Z+^' \0, describing the 
queue at this server. Then v a = j^^2 cea S Xc . We define the derived process 



'm, p = J Va dp M , P (cr) . 



Mm 

Clearly, we can take the limit of p' Mp as M — > oo, keeping p fixed. The 
limiting process - the derivative - p'^ p will be also NLMP. 

It can be described alternatively as follows. The state of the NLMP on the 
graph G — (V, E) is represented by the collection of \V \ probability measures 
p v , v G V, defined, correspondingly, on lattices Z+^'. For every x G Z we 
put \x\ — x\ + ... + Xd(x), where d (x) is the dimension of x. The derivative is 

a single probability measure p! on the disjoint union Z = U vG y \ 0^ 

of lattices. It is defined by its density with respect to various p v -s: for every 
x G Z!f {v)l \ C Z we put 

( x ) = j^r^ \ x \ (x) , where N (p) = ^ p (x) = ^ \x\ p v (x) . 

Since all our measures have exponential moments, the above normalization 
is possible. The recovering of the probability measures p v from p! can be 
done only "up to a constant" , as usual. We will take care of it below. 



10 



In accordance with our choice of variables we introduce the norm 

iwi = E# w - ( 9 ) 

In case of the signed measure \x on Z, we define ||/x|| by the same relation, 
with fi (x) replaced by \fj, (x)\ . Below we are assuming that all the measures 
jj, considered are elements of the space Y of measures on Z with finite norm 

The process /i' is again a NLMP. Note, however, that the limit fj/ = 
lim p ^o n'oo p is a usual (linear) Markov process on Z. It is defined by the fol- 
lowing jump rates. Let v be a server, and x G Z+^' C Z, x — (xi, %\c(v)\) ■ 
We will suppose that the coordinates are listed in the priority order, so if 
x = (xi, Xk-i, Xk, 0, ...,0) , with Xk > 0, then after a single act of service 
the queue will be x = (x±, Xk-i, Xk — 1, 0, 0) . The rate c x ^ s of the jump 
x — > x is then 




Y,l(v,k)P[(v,k),(v i ,c j )}, (10) 



i,3 

where the sum is taken over all possible outcomes of the service at v of the 
client of k-th priority. Another possible jump for the process //^ from x is 

to the cite 1^- = (0, 0, lj, 0, 0) G Z^^ 1 -" C Z; it happens with the rate 

Ca^iy = r-rl (v, k) P [(v, k) , (v h cj)} . (11) 

From the definitions ( flOl) — (TlTT) and our Condition [1] it follows that the 
process y!^ is ergodic, and its stationary distribution coincides with that of 
the Markov process on G, corresponding to the Case of a Single Client. 

3.3 Dynamics 

The NLMP dynamics in '-coordinates is given by a differential equation 

fi(t) = F(fi(t)), //(0)=/i . (12) 

The right-hand side of ffl2|) is the sum of two terms; the first one is linear in 
fi, and the second one is quadratic: 

F( f i) = G f i + pH( f i). (13) 
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To convince the reader, we will write down these equations for the system 
studied in jRShVlj . 

The description of the NLMP in |RShVlj was done via probability mea- 
sure v t = {ft (x) , x e Z 5 } . Its evolution was given by the equation 



dv t [x 



dt -« {X) 



( E 

\a=0,A,B,AB,BA / 

-^0*0 I 7 (1-4J+7a(1-4 a )^ba + 7b(1-^ b )^ s ) 

\a=0,AB,BA / 

+ v t (x- A ) (1 - S Xo ) (Xab (t) + \ BA (*)) + Ut ( x ~ A «) t 1 ~ 5 ^ ~ 



a=A,B 

+ v t (x- A AB ) (1 - 8 XAB ) \ A (t) +u t (x- A BA ) (1 - 8 XBA ) X B (t) 

+ ^ v t{x + A a ) 7 a + V t (X + A A ) Ja^xba +V t {x+ A S ) JbSxab , 
a=0,AB,BA 

where 

Aa (£) = la Vt ( x ) ' for a = O, AB, BA, 

x:x a >0 

Aa (t) =1a Y Ut ( x "> ' Xb (*) = 75 fc) ' 

x:x j 4>0,a; flj 4=0 x:x fl >0,x J 4 fl =0 

and the 5D vectors A a are the basis vectors of the lattice Z 5 . In fact, v t = 
uf x vf x is° , where the probability measures uf , i/^ are defined on Z+, while 
i/f - on Z+, and their evolution is given by the relations 

= -4 (*) + As (t) + 7ba (1 - <W) + 7A (1 - <W S XBA 

+ uf (x - A A ) (1 - 5 XA ) + vf (x - A BA ) (1 - S XBA ) X B (t) 

+ vf (x + A A ) j A 5 XBA + vf (x + A BA ) -y BA , 
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< ^f 1 = (x) + \ A (t) + lAB (1 - 5 XAB ) + 1B (1 - 5 XB ) 5 XAB 



+ v? (x - A B ) (i- SxB )*°M + v? (x - A AB ) (1 - 5 XAB ) X A (t) 



+ vf (x + A B ) -y B 5 XAB + uf (x + A AB ) ^ AB , 



dv° (x) 



,o 



( K(t)+io(l-5 xo )) 

\a= A B,B A J 



dt 

+ v° (x - A ) (1 - 5 Xo ) (X AB (t) + \ BA (*)) + i/f (x + A ) 7o- 

The new '-variables are introduced as follows: v' t ° (x) = ^ Ut — (with x G 
Z*_), v' t A {x) = if (a) = (with x G Z^_), \x\ > 1, where 

p = XIxgz 5 M ^ ( x ) ^ s ^ ne number of particles, (which is conserved). Substi- 
tuting, we have for x ^ A BA , A a 

\ x:xq>0 x:xb>0,xab=0 



+ i™,^(*-A M )(i-4„) £ \f 

+ i I^L A A (x + Aa) 7a<W + j^J — -A A (x + A BA ) lBA 

\X ~T l\a\ \X i L± BA \ 

- v 't A (x) {.1b A (1 - 5 XBA ) + (1 - S XA ) 5 XBA ) . 

Also, 



H A (Aa) , a (A Jlo V if (x) v if (x) 

p 7o ^ *f jx) j2 u '° ^ (15) 

^ |x|>0 ^ x:a;o>0 ^ 

+ y E ^^ + ^(2A A )7A + ^(A A + A BA ) 7BA -z,f(A A ) 7A , 

a;:a;o>0 
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dv[ A (A BA ) 
dt 



<A (A , I lO V- V't° (X) 

-pv t (A BA ) \ y 1^ y 



a;:a;o>0 



E 



x:x B >0,x AB =0 



v? (x) 



\x\ 



v[ B (x) 



X X 
\x\>0 1 x:x B >0,x AB =0 



(16) 



, 1. 



+ -z/f (2A BA ) 7jm - v't (A BA ) Iba 

\X\ Zi 



x:x B >0,x AB =0 

The identical relations hold for the measure v' t B . For the measure u' t ° we get 



dv? ( 
dt 



,) p (\xW°(x-l) _ v , 0{x) 



\x-l\ 



lAB 



E 



^ (*) 



+ 



7o for |x| > 1, 



x:x BA >0 

(17) 



.r 



(i) 

dt 



-> E 



if (s) 



+ 4° (1) 



+ 



1 



x:xas>0 



v[ B (x) 



X 



+ 1BA 

x:x BA >0 



V[ A (X) 



X 



-^(l) + 2^(2) 



7o + 



x:x AB >0 



x:x BA >0 



\X\ 



(18) 



As we see, the quadratic terms all have the factor p in front of them. Putting 
it to zero, we get the linear part of the evolution: 



dv' t A (x) 


X 




dt 


X 


+ 1 



jA 





X 




\x 


+ 1 



jA 



v' t (x) (-is a (1 - S XBA ) + 1a(1-5 xa ) 5x ba ) 



for x 7^ Aba, Aa- Also, 

dv[ A (A A ) 
dt 



To 
2 



E 

x:xq>0 



v? (x) 
\x\ 



+ l -u' t A (2A A ) Ja 



(20) 



1 



v' t A (A A + Aba) Iba - v' t (&a) 1a, 



14 



dv[ A (A 



BAi 



dt 



is Yl 

x:x b >0,xab=0 



v't B (a) 

\x\ 



Exchanging the indices A 
we have 



+ l -v' t A (2A BA ) lBA - v' A {A BA ) Jba- 



(21) 



B, we get the equations for v\ ' . As for z/ 



(x) 



dv? (1) 
dt 



-v? (1) 



|x + 1| 

7o + 



x+1) 



7o for |x| > 1, 



122) 



E 



a=AB,BA 



7 



■•E 

x:a; £l >0 



v\ a (x) 



\x\ 



We want to establish the contraction property of the evolution ([13 
in particular, the evolution (|T4|) — ({TBI) . 

To exhibit it we will compare it with the linear evolution 

fi\t) = Gfi\t), fj, l {0) = («>, 



for x = 1. 



(23) 



so, 



(24) 



with the same initial point. This is the Markov process with rates (|T0|) — (fTTl) , 
discussed above. In our example the linear evolution is given by (TT91) — ( |23l) . 
Its informal description is the following. Consider the infinite network Q^, 
which is populated by infinitely many clients, having nevertheless zero den- 
sity: p = 0. The initial distribution /i of the queue seen by an average client 
can be arbitrary. The dynamics is the following: after waiting in the queue 
and then being served, the client goes to a next server of corresponding type 
- but he finds it free with probability one! The reason is the vanishing den- 
sity: it is improbable that a client will get to an occupied server. Therefore 
in the limit t — ► oo the measure (j!(t) is concentrated only on points x G Z 
with property |x| = 1. 

This linear evolution is contracting in the following sense: for every K > 
there exists the time T = T (K) < oo, such that for every two trajectories 
fj\(t) and /4(£) with 11/4(0) II < K we have for alH > 



l/4(t+T)-/4(i+T)|| <i||/4(t) 



(25) 



Let us define on the subspace Y = {y G Y : v (Z) = 0} a new norm: 



i pt \\v l {t)\\dt, 



(26) 
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where v l (t) is the solution of (j24p with v l (0) = v. If (3 > is small enough, 
the norm is finite on Y and equivalent there to ||-||. Moreover (unlike 
the norm ||-|| !), it satisfies the infinitesimal version of (125]) : for any t > 



— I 



< 



/4 



3.4 Non- linear part 

The quadratic part of f[T2"]) can be written as 

x,yEZ 



H (x) fi (y) 



\y\ 



where z G Z, and for every pair x,y £ Z the function v xy (z) on 2 has finite 
support, the size of which depends only on the structure of the network G. 
To see this, let us fix a pair of points x,y G Z, and mark the equations 
... from those listed above, (114]) — fllSQ , containing the cross-term 



(*) ^ (y) 



Let us write down the vector \ xy = {v xy {z) , z G Z} . This 



vector is non-zero only if the two indices x, y belong to two different lattices 
among the three present: O, A or B. For example, if x G O, x ^ 1 and y G A, 
y A B a, A a, then the following six coordinates of v xy are non-zero: 



(v) 



lo 



2 M 



v xy (y + A A ) 



lo \y + A A \ 


2 


X 


\y 





(Aa) 



To 



v xy [X) 



JBA 

\y\ 



Vxj/ \ x 



1) 



|x + 1 


7ba 








y\ 



.ilj 



(1) 



2 |?/| \x\ 

IBA 



\x\ \y\ 



(the last three relations require ysA > 0) . The rest of them vanish. 

It is also easy to see that for some constant C > and for each pair 



x, y G Z we have || v 



< CeM+M (see 



3.5 Convergence 

Let us estimate H(n) — H{y). We have 

\\H( t i)-H(u)\\< J2 \\v xy \ 

x,y&Z 



l^x fty 

\x\ \y\ 



v x V, 



\x\ \y\ 



< 
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x,y£X 



( 


lh_ _ 




+ Yjl 




) 


V \ x \ 


\v\ 


\v\ 


\y\ 







c E 



,|s| Afx 



I y\ 



\v\Y± 

\y\ 



,\x\\J^ 



\x\ 



< 



<C{M + \\u\\)\\vl-u\\. (27) 
By the equivalence of || ■ || and || • we get the bound 

HJ5T0*) - jstmik < ctlCHa*!! + HHDII/* - HU- (28) 

For our NLMP we have 

j t Mt) - < -py® - m\i + Pimm - H(Ht))h- (29) 

It remains to notice that for every K > there exists a constant C 2 > 
such for any /i(0) G Y with ||/u(0)|| < if we have \\ft(t)\\ < C 2 K for all t, so 
according to (128]) , the first term beats the second one, once p is small. 

Now let us go back to our initial NLMP with low load p. Let x (t) be 
some trajectory of it, with ||x(t)|| < C 2 K, while \ p De stationary "Poisson 
Hypothesis" trajectory. Then the derivative process x' it) satisfies f[T51) , so 
by fl2"9~j) we have 



|||X' (f) - 111 <(-/? + P<?1 ( + ||(X P )'| 



Since x(t) is the only measure with the load p, having derivative x 7 (£), our 
claim is proven. 
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